" Turing Machines 


Reading: Chapter 8 


Turing Machines are... 


в Very powerful (abstract) machines that 
could simulate any modern day 
computer (although very, very slowly!) 


в Why design such a machine m 


= Ifa problem cannot be solved" even using 
a ТМ, then it implies that the problem is 
undecidable 


=» Computability vs. Decidability 
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* A dA Machine (TM) 


- (a, У, Г, ő, I = Eg 


Input & output tape symbols 2 


B: blank symbol (special symbol reserved to indicate data boundary) 
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You can also use: 
Э for R 
€ forL 


Transition function 


= One move (denoted by |---) 
in a TM does the following: X/YD 
E ó(q,X) = (р, Y,D) О (р) 


= q is the current state 
s X is the current tape symbol pointed by 
tape head 
= State changes from q to p 
= After the move: 
= X is replaced with symbol Y 
= If DEL", the tape head moves “left” by 
one position. 
Alternatively, if D-“R” the tape head 
moves "right" by one position. 


IDofa IM 


= Instantaneous Description or ID : 
a Х,Х,...Х ХХ ,...Х,„ 
means. 
= Gis the current state 
» Tape head is pointing to X; 
a Х,Х„...Х,,Х,Х,,...Х„ are the current tape symbols 


= 0(9,Х,) = (p,Y,R) is same as: 
X...X40X...X, |---- X,..X4YpX,,...X, 

= 0(9,Х,) = (p,Y,L) is same as: 
X,...XaqX...X, |--- X... pX4YX...X, 


Way to check for Membership 


= Is a string w accepted by a TM? 


= Initial condition: 
» The (whole) input string w is present in IM, 
preceded and followed by infinite blank symbols 
= Final acceptance: 
= Accept w if TM enters final state and halts 
= If TM halts and not final state, then reject 


Example: L = 40717 | n21} 


= Strategy: w = 000111 


— ЕТ ЕЕ - 


_ PETET 


Accept 
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Y/YR 
0/0,R 


* 


TM for 40717 | n21} 


Mark next unread O with X 
and move right 


Move to the right all the way 
to the first unread 1, and mark 
it with Y 

Move back (to the left) all the 
way to the last marked X, and 
then move one position to the 
right 

If the next position is 0, then 
goto step 1. 

Else move all the way to the 
right to ensure there are no 
excess 1s. If not move right to 
the next blank symbol and 
stop & accept. 


“state diagram representation preferred 


TM mE 01717 | n21} 


Next Tape Symbol 


um rr. 
ка 


PS eon [s] — em | — 
[s [m [я ыы БВ 
эр р Cd авт 
ST 


Table representation of the state diagram 


| TMs for calculations 


= [Ms can also be used for calculating 
values 
= Like arithmetic computations 


= Eg., addition, subtraction, multiplication, 
etc. 


Example 2: monus subtraction 


“т -- п” = max{m-n,0} 
0"10" ә ...B OM" B.. (if m»n) 
...BB...B.. (otherwise) 


1t . For every Oon the left (mark X), mark off a 0 on the right 
(mark Y) 
2 Repeat process, until one of the following happens: 
1. // No more Os remaining on the left of 1 
Answer is 0, so flip all excess Os on the right of 1 to Bs 
(and the 1 itself) and halt 
2. //No more Os remaining on the right of 1 
Answer is m-n, so simply halt after making 1 to B 


Give state diagram 


Example 3: Multiplication 


= 0"10"1 (input), 0mn1 (output) 


= Pseudocode: 


t Move tape head back & forth such that for every 
О seen in OT, write n Os to the right of the last 
delimiting 1 

Once written, that zero is changed to B to get 
marked as finished 


3. After completing on all т Os, make the 
remaining n Os and 1s also as Bs 


Give state diagram 


Calculations vs. Languages 


Ji 


E.g., The language L4, for the addition operation 


“<0#0,0>” 
“<0#1,1>” 


“<2#4,6>” 


Membership question == verifying a solution 
e.g., is “<15#12,27>” a member of Lig, ? 13 


Language of the Turing 
Machines 


= Recursive Enumerable (RE) language 


sensitive 


Recursively 
Enumerable 
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| Variations of Turing Machines 


M" TMs with storage V "enema 


= E.g., TM for 01* + 107 


° 5([qo,B],a) = ([q4.a]. a, R) 


Tape head • $([9:,а],а) = (Ias,al, a, R) 


Bie] Вв]. sta. 8) = (02818, R) 


| | Are the standard TMs Yes 
[q,a]: — where q is current state, eguivalent to TMs with storage? 
a is the symbol in storage 16 


Standard TMs are equivalent to TMs 
M" with storage - Proof 
Claim: Every TM w/ storage can be simulated 
by a TM w/o storage as follows: 
= For every [state, symbol] combination in 
the TM w/ storage: 
« Create a new state іп the TM w/o storage 
= Define transitions induced by TM w/ storage 


Since there are only finite number of states and 
symbols in the TM with storage, the number of states 
in the TM without storage will also be finite 


Multi-track Turing Machines 


= IM with multiple tracks, 
but just one unified tape head 


One tape head to read 
k symbols from the k tracks 
Ta at one step. 


Track 1 
Track 2 


Track k 


—r— 


| Multi- Į rack TMs 


= ТМ with €— tracks" A just one 


EEEEEGHHEE 8 | 


.. Track 1 


. Track 2 


Second track mainly used as a scratch space for marking 1° 


Multi-track IMs are eguivalent 
to basic (single-track) IMs 


=» Let M be a single-track TM 
= M= (Q, >, Г, 6, do. BF) 


=» Let M’ be a multi-track TM (k tracks) 
s M=(Q,) I ©, doBF) 
н 0 (4,<а;,а,...а) = (9, <0;,02,...бұ>, ШК) 


= Claims: 
= For every M, there is ап M’ s.t. L(M)=L(M’). 
= (proof trivial here) 


Multi-track TM ==> TM (proof) 


= For every М’, there is an M s.t. L(M’)=L(M). 


= M=(Q, 5, Г, 6, qo,[B.B....],F) 
"Н Where: 


2-2 x} ‘x... (k times for k-track) 
Г=Г'хГ'х... (ktimes for k-track) 


9(q;,[81,85....a]) = 6 (qj, <ау,а›,...а,>) 
= Multi-track TMs are just a different way to 
represent single-track TMs, and is a matter of 
design convenience. 
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Multi-tape Turing Machines 


= TM with multiple tapes, each tape with a 
separate head 


=» Each head can move independently of the 
others 


__. К separate heads 


On how a Multi-tape TM would 
operate 


a Initially: 
» The input is іп tape #1 surrounded by blanks 
= All other tapes contain only blanks 
» [he tape head for tape #1 points to the 1% symbol of the 
input 
» [he heads for all other tapes point at an arbitrary cell 
(doesn't matter because they are all blanks anyway) 


= А move: 


» Is a function (current state, the symbols pointed by all the 
heads) 


= After each move, each tape head can move independently 
(left or right) of one another 
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| Multitape IMs = Basic IMs 


=» [heorem: Every language accepted by a k- 
tape TM is also accepted by a single-tape TM 


=» Proof by construction: 
=" Construct a single-tape TM with 2k tracks, where 
each tape of the k-tape TM is simulated by 2 
tracks of basic TM 
= К out the 2k tracks simulate the К input tapes 
= The other k out of the 2k tracks keep track of the К 
tape head positions 
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Multitape TMs = Basic TMs... 


=» To simulate one move of the k-tape TM: 

Move from the leftmost marker to the rightmost marker (k markers) and in 
the process, gather all the input symbols into storage 

Then, take the action same as done by the k-tape TM (rewrite tape symbols 
& move L/R using the markers) 


Track 1 


Track 2 
Track 3 


Track 4 
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Non-deterministic I Ms 


s» ATM can have non-deterministic moves: 
= б(0,Х) = { (91,11,01), (9,2,0), ... } 
=» Simulation using a multitape deterministic 


B ES 
Input tape | 


Marker tape 


Scratch tape 


Summary 


=» IMs == Recursively Enumerable languages 


= [Ms can be used as both: 
"Н Language recognizers 
= Calculators/computers 
=» Basic TM is equivalent to all the below: 
1 ТМ + storage 
2 Multi-track TM 
з  Multi-tape TM 
4  Non-deterministic TM 
= [Ms аге like universal computing machines 
with unbounded storage 
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